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1.0 INTRODUCTION 

ADS Is a general purpose numerical optimization program containing 

a wide variety of algorithms. The problem solved is: 

Minimize F(X) 

Subject to; 

^ ® j“l»o 

hit(X) =• 0 k=»l,i 

4 < Xi < 4 i-l,„ 

levels^^ solution of this general problem is separated into three basic 
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STRATEGY - For example. Sequential Unconstrained Minimization or 
Sequential Linear Programming. 

OPTIMIZER - For example. Variable Metric methods for unconstrained 
minimization or the Method of Feasible Directions for constrained 
minimization. 

Interpolatlo^ SEARCH - For example, Golden Section or Polynomial 

fn^m consider another component to be problem 

mulation. It is assumed that the engineer makes every effort to 
formulate the problem in a form amenable to efficient solution by 
numerical optimization. This aspect is perhaps the most important 
ingredient to the efficient use of the ADS program for solution of 
problems of practical significance* 

By choosing the Strategy, Optimizer and One-Dimensional Search, the 
user is given considerable flexibility in creating an optimization 
program which works well for a given class of design problems. 

The purpose here is to describe the use of the ADS program and the 
available program options. Section 2 identifies the available 
optimization strategies, optimizers and one-dimensional search 
a gorlthms. Section 3 defines the program organization, and Section 4 
instructions. Section 5 presents several simple examples to 
aid the user in becoming familiar with the ADS program. Section 6 gives 
a simple main program that is useful for general design applications. 
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2.0 PROGRAM OPTIONS 


In this section, the options' available In the ADS program are 
Identified. At each of the three solution levels, several options are ' 
available to the user. 


2.1 Strategy 

Table 1 lists the strategies available. The parameter ISTRAT will 
be sent to the ADS program to Identify the strategy the user wants. The 
ISTElAT-0 option would Indicate that control' should transfer directly to 
the optimizer. This would be the case, for example, when using the 
Method of Feasible Directions to . solve constrained optimization problans 
because the optimizer works directly With the constrained problem. On 
the other hand, if the constrained optimization problem is to be solved 
by creating a sequence of unconstrained minimizations, with penalty 
functions to deal with constraints, one of the appropriate strategies 
would be used. 

TABLE 1: STRATEGY OPTIONS 

ISTRAT STRATEGY TO BE USED 

0 None. Go directly to the optimizer. 

1 Sequential unconstrained minimization using the exterior 
penalty function method (refs,. 1, 2). 

2 Sequential unconstrained minimization using the linear 
extended Interior penalty function method (refs. 3-5). 

3 Sequential unconstrained minimization using the quadratic 
extended Interior penalty function method (refs. 6, 7). 

4 Sequential unconstrained minimization using the cubic 
extended interior penalty function method (ref. 8). 

5 Augmented Lagrange Multiplier method (refs. 9-13). 

6 Sequential Linear Programming (refs. 14, 15). 

7 Method of Centers (method of inscribed hyperspheres) 

(ref. 16) . 

8 Sequential Quadratic Progr amm i ng (refs. 11, 17, 18). 


2.2 Optimizer 

Table 2 lists the optimizers available. lOPT Is the parameter used 
to Indicate the optimizer desired. 
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TABLE 2: OPTIMIZER OPTIONS 

lOPT OPTIMIZER TO BE USED 

0 None. Go directly to the one-dimensional search. This 
option should be used only for program development. 

1 Fletcher-Reeves algorithm for unconstrained minimization 
(refs. 19). 

2 Davidon-Fletcher-Powell (DFP) variable metric method for 
unconstrained minimization (refs. 20, 21). 

3 Broydon-Fletcher-Goldfarb-Shanno (BFGS) variable metric 
method for unconstrained minimization (refs. 22-25). 

4 Method of Feasible Directions (MFD) for constrained 
minimization (refs. 26, 27). 

5 Modified Method of Feasible Directions for constrained 
minimization (ref. 28). 


In choosing the optimizer (as well as strategy and one-dimensional 
search) it is assumed that the user is knowledgeable enough to choose 
an algorithm consistent with the problem at hand. For example, a 
variable metric optimizer would not be used to solve -constrained 
problems unless a strategy is used to create the equivalent 
unconstrained minimization task via some form of penalty function. 

2.3 One-Dimensional Search 


Table 3 lists the one-dimensional search options available for 
unconstrained and constrained problems. Here lONED identifies the 
algorithm to be used. 

TABLE 3: ONE-DIMENSIONAL SEARCH OPTIONS 

lONED ONE-DIMENSIONAL SEARCH OPTION (refs. 1, 29, 30) 

1 Find the minimum of an unconstrained function using the 
Golden Section method. 

2 Find the minimum of an unconstrained function using the 
Golden Section method followed by polynomial interpolation. 

3 Find the minimum of an unconstrained function by first 
finding bounds and then using polynomial interpolation. 

4 Find the minimum of an unconstrained function by polynomial 
interpolation/extrapolation without first finding bounds on 
the solution. 

5 Find the minimum of an constrained. function using the 
Golden Section method. 

6 Find the minimum of an constrained function using the 
Golden Section method followed by polynomial interpolation. 

7 Find the minimum of an constrained function by first 
finding bounds and then using polynomial interpolation. 

8 Find the minimum of an constrained function by polynomial 
interpolation/extrapolation without first finding bounds on 
the solution. 
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2»4 Allowable Combinations of Algorithms 


Not all combinations of strategy, optimizer and one-dimensional 
search are meaningful. For example, constrained one -dimensional search 
is not meaningful when minimizing unconstrained functions. 

Table 4 identifies the combinations of algorithms which are 
available in the ADS program. In this table, an X is used to denote an 
acceptable combination of strategy, optimizer and one-dimensional 
search. An example is shown by the heavy line on the table which 
indicates that constrained optimization is to be performed by the 
Augmented Lagrange Multiplier Method (ISTRAT=5), using the BFGS 
optimizer (I0PT*3) and polynomial interpolation with bounds for the one- 
dimensional search (I0NED=*3). From the table, it is clear that a large 
number of possible combinations of algorithms are available. 


TABLE 4; PROGRAM OPTIONS 





OPTIMIZER 


STRATEGY 

1 

2 


3 

4 

0 

X 

X 


X 

X 

1 

X 

X 


X 

0 

2 

X 

X 


X 

0 

3 

X 

X 


X 

0 

4 

X 

X 


X 

0 

CD 

X 

— X 



0 

6 

0 

0 


0 

X 

7 

0 

0 


0 

X 

8 

0 

0 


0 

X 


5 

X 

0 

0 

0 

0 

0 

X 

X 

X 


ONE-D SEARCH 
1 
2 

3 

4 

5 

6 

7 

8 


X 

X 

X 

X 

0 

0 

0 

0 


X I X 0 

X ^X 0 

X @ 0 

X X 0 

0 0 X 

0 0 X 

0 0 X 

0 0 X 


0 

0 

0 

0 

X 

X 

X 

X 


Appendix A contains an annotated version of Table 4 for convenient 
reference once the user is familiar with ADS. 

To conserve computer storage, it may be desirable to use only those 
subroutines in the ADS system needed for a given combination of ISTRAT, 
lOPT and lONED. Appendix C provides the information necessary for this. 
Appendix D lists the subroutines with a very brief description of each. 


3.0 PROGRAM FLOW LOGIC 

ADS is called by a user-supplied calling program. ADS does not 
call any user-supplied subroutines. Instead, ADS returns control to the 
calling program when function or gradient Information is needed. The 
required Information is evaluated and ADS is called again. This 
provides considerable flexibility in program organization and restart 
capabilities • 
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ADS can be used In four principal modes: 

1. Default Control parameters and finite difference gradients. 

2. Over-ride default parameters, use finite difference gradients. 

3. Default control parameters and user-supplied gradients. 

4. Over-ride default parameters and user-supplied gradient. 

The first mode is the simplest "black box" approach. In the second 
mode, the user over-rides the default parameters to "fine tune" the 
program for efficiency. In modes 3 and 4, the user supplies all needed 
gradient information to the program. 

Figure 1 is the program flow diagram for the simplest use of AOS. 
The user begins by defining the basic control parameters and arrays (to 
be described in Section 4). The gradient computation parameter, IGRAD, 
is set to zero to indicate that finite difference gradients will be 
used. The information parameter, INFO, is initialized to zero and ADS 
is called for optimization. Whenever the values of the objective, OBJ, 
and constraints, G(I), I=1,NC0N, are required, control is returned to 
the user with INF0=1. The functions are then evaluated and ADS is 
called again. When INFO=0 is returned to the user, the optimization is 
complete. 


BEGIN 

DIMENSION ARRAYS 
DEFINE BASIC VARIABLES 
IGRAD 0 
INFO <— 0 



Figure 1: Simplified Program Usage; All Default 

Parameters and Finite Difference Gradients ; 


5 - 



Figure 2 is the program flow diagram for the case where the user 
wishes to over~ride one or more internal parameters, such as convergence 
criteria or maximum number of Iterations, kere, after initialization of 
basic parameters and arrays, the information parameter, INFO, is set to 
-2. ADS is then called to initialize all internal parameters and 
allocate storage space for internlil arrays. Control is then returned to 
the user, at which point these parameters, for example convergence 
criteria, can be over-ridden if desired. At this point, the information 
parameter, INFO, will have a value of —1 and should not be changed. ADS 
is then called again and the optimization proceeds. Section 4.3 
provides a list of internal parameters which may be modified, along with 
their locations in the work arrays WK and IWK. 


BEGIN 

DIMENSION ARRAYS 
DEFINE BASIC VARIABLES 
IGRAD <— 0 
INFO'-< 2 

CALL ADS (INFO . • • ) 

OVER-RIDE 'DEFAULT PARAMETERS 
WHICH ARE NOW CONTAINED IN 
arrays WK AND IWK IF DESIRED 



Figure 2: Program Flow Logic; Over-ride Default 
Parameters, Finite Difference Gradients 

Figure 3 is the flow diagram for the case where the user wishes to 
provide gradient information to ADS, rather than having ^ADS calculate 
this information using finite difference methods. ' In Figure 3, it is 
also assumed that the user will over-ride some internal parameters, so 
the difference between Figures 2 and 3 is that IGRAD is now set to 1 and 
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the user will now provide gradients during optimization. If the user 
does not wish to over-ride any default parameters, INFO Is Initialized 
to zero and the first call to ADS Is omitted (as In Figure 1). Now, 
when control Is returned to the user, the Information parameter will 
have a value of 1 or 2 (If INF0»0, the optimization Is complete, as 
before). If INF0=1, the objective and constraint functions are 
evaluated and ADS Is called again, just as In Figure 2. If INF0*>2, the 
gradient, DF, of the objective function Is evaluated as well as the 
gradients of NOT constraints defined by vector IC. 


BEGIN 

DIMENSION ARRAYS 
DEFINE BASIC VARIABLES 
IGRAD 1 

INFO < 2 

CALL ADS (INFO . . . ) 

OVER-RIDE DEFAULT PARAMETERS 
WHICH ARE NOW CONTAINED IN 
ARRAYS WK AND IWK IF DESIRED 


>-CALL ADS (INFO . . . ) 



OBJECTIVE GRADIENT OF 


AND OBJECTIVE 

CONSTRAINTS AND SPECIFIED 

i CONSTRAINTS 

h 


Figure 3: Program Flow Logic; Over-ride Default 

Parameters and Provide Gradients 
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4.0 USER INSTRUCTIONS 

In this section, the use of the ADS program is outlined. The 
FORTRAN Call statement to ADS is given first, and then the parameters in 
the calling statement are defined. Section 4.3 identifies parameters 
that the user may wish to over-ride to make more effective use of ADS. 
Arrays are designated by boldface print. 


4.1 Calling Statement 

ADS is invoked by the following FORTRAN calling statement in the 
user's program: 

CALL ADS (INFO,ISTRAT,IOPT,IONED,IPRINT,IGRAD,NDV,NCON,X, 

* VLB,VDB,OBJ,G,IDG,NGT,IC,DP,A,NRA,NCOLA,WK,NRWK,IHK,NRIWK) 

4 . 2 Definitions of Parameters in the ADS Calling Statement 

Table 5 lists the parameters in the calling statement to ADS. Where 
arrays are defined, the required dimension size is given as the array 
argument. 

TABLE 5: PARAMETERS IN THE ADS ARGUMENT LIST 

PARAMETER DEFINITION 

INFO Information parameter. On the first call to ADS, INF0=0 or -2. 

INF0*«0 is used if the user does not wish to over-ride internal 
parameters and INFO—2 is used if internal parameters are to be 
changed. When control returns form ADS to the calling program, 
INFO will have a value of 0, 1, or 2. If INF0*0, the 
optimization is complete. If INFO=l, the user must evaluate 
the objective, OBJ, and constraint functions, G(I), I=»1,NC0N, 
and call ADS again. If INF0=2, the user must evaluate the 
gradient of the objective and the NGT constraints Identified by 
the vector IC, and call ADS again. If the gradient calculation 
control, IGRAD-0, INF0“2 will never be returned from ADS, and 
all gradient information is calcinated by finite difference 
within ADS. 

ISTRAT Optimization strategy to be used. Available options are 
identified in Tables 1 and 4. 

lOPT Optimizer to be used. Available options are identified in 
Tables 2 and 4. 

lONED One-dimensional search algorithm to be used. Available options 
are identified in Tables 3 and 4. 
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TABLE 5 CONTINUED: PARAMETERS IN THE ADS ARGUMENT LIST 

PARAMETER DEFINITION 

IPRINT A four-digit print control. IPRINT=IJKL where I, J, K and L 
have the following definitions: 

I ADS system print control. 

0 - No print. 

1 - Print initial and final information. 

2 - Same as 1 plus parameter values and storage needs. 

3 - Same as 2 plus scaling information calculated by ADS. 

J Strategy print control. 

0 - No print. 

1 - Print initial and final optimization information. 

2 - Same as 1 plus OBJ and X at each iteration. 

3 - Same as 2 plus G at each iteration. 

4 - Same as 3 plus Intermediate information. 

5 - Same as 4 plus gradients of constraints. 

K Optimizer print control. 

0 - No print. 

1 - Print initial and final optimization Information. 

2 - Same as 1 plus OBJ and X at each iteration. 

3 - Same as 2 plus constraints at each iteration. 

4 - Same as 3 plus intermediate optimization and 

one-dimensional search information. 

5 - Same as 4 plus gradients of constraints. 

L One-Dimensional search print control, (debug only). 

0 - No print. 

1 - One-dimensional search debug information. 

2 - More of the same. 

Example: IPRINT=3120 corresponds to I«3, J=l, K=2 and L=*0. 

NOTE: IPRINT can be changed at any time control is returned to 
the user. 

IGRAD Gradient calculation control. If IGRAD=*0 is input to ADS, all 
gradient computations are done within ADS by first forward 
finite difference. If IGRAD»1, the user will supply gradient 
information as indicated by the value of INFO. 

NDV Number of design variables contained in vector X. NDV is the 

same as n in the mathematical problem statement. 

NCON Number of constraint values contained in array G. NCON is the 
same as m+ in the mathematical problem statement given in 
Section 1.0. NC0N»0 is allowed. 

X(NDV+1) Vector containing the design variables. On the first call to 
ADS, this is the user’s initial estimate to the design. On 
return from ADS, this is the design for which function or 
gradient values are required. On the final return from ADS 
(INFO=0 is returned), the vector X contains the optimum design. 

VLB(NDV+1) Array containing lower bounds on the design variables, X. If 
no lower bounds are imposed on one or more of the design 
variables, the corresponding component(s) of VLB must be set to 
a large negative numter, say -l.OE+13. 

VUB(NDV»1) Array containing upper bounds on the design variables, X. If 
no upper bounds are imposed on one or more of the design 
variables, the corresponding component(s) of VUB must be set to 
a large positive number, say l.OE+15. 
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TABLE 5 CONTINUED; PARAMETERS IN THE ADS ARGUMENT LIST 

PARAMETER DEFINITION 

Value of the objective function corresponding to the current 
values of the design variables contained In X. On the first 
call to ADS, OBJ need riot he defined. ADS will return a value 
of INF0=1 to indicate that the user must evaluate OBJ and call 
ADS again. Subsequently, any time a value of INF0=1 is 
returned from ADS, the objective, OBJ, must be evaluated for 
the current design and ADS must be called again. OBJ has the 
same meaning as F(X) in the mathematical problem statement 
given in Section 1.0. 

Array containing NCON constraint values corresponding to the 
current design contained in X. On the first call to ADS, the 
constraint values need not be' defined. On return from ADS, if 
INF0*1, the constraints must be evaluated for the current X and 
ADS called again. If NCON=0., array G should be dimensioned to 
unity, but no constraint values need to be provided. 

IDG(NCON) Array containing Identifiers indicating the type of the 
constraints contained in array G. . 

IDG(I) = -2 for linear equality, constraint. 

IDG(I) = -1 for nonlinear equality constraint. 

IDG(I) = 0 or 1 for nonlinear inequality constraint. 

IDG(I) = 2 for linear inequality constraint. 

NOTE; In ADS Version 1.00, equality constraints are only 
operational for SUMT methods, ISTRAT=1-,5. 

NGT Number of constraints for which gradients must be supplied. 

NGT is defined by ADS as the minimum of NCOLA and NCON and is 
returned to the user. 

IC(NGT) Array identifying constraints for which gradients are required. 
IC is defined by ADS and returned to the user. If INF0=*2 is 
returned to the user, the gradient of the objective and the NGT 
; constraints must be evaluated and stored In arrays DF and A, 
respectively, and ADS must be called again. 

DF(NDV+1) Array containing the gradient of the objective corresponding 
to the current X. Array DF must be defined by the user when 
INF0=2 is returned from ADS. This will not occur if IGRAD=0, 
in which case array DF is evaluated by ADS. 

A(NRA, NCOLA) Array containing the gradients of the NGT constraints 

identified by array IC. That is, column J of array A contains 
the gradient of constraint number K, where K“IC(J). Array A 
must be defined by the user when INF0=»2 is returned from ADS 
and when NGT.GT.O. This will riot occur if IGRAD=0, in which 
case, array A is evaluated by ADS. NRA is the dimensioned 
rows of array A. NCOLA is the dimensioned columns of array A. 

NRA Dimensioned rows of array A. NRA must be at least NDV+1. 

NCOLA Dimensioned columns of array A.. NCOLA should be at least the 

minimum of NCON and 2*NDV. If enough storage is available, and 
if gradients are easily provided or are calculated by finite 
difference, then NC0LA-NC0N4-NDV is ideal. 

WK(NRWK) User provided work array for real variables. Array WK is used 
to store Internal scalar variables and arrays used by ADS. WK 
must be dimensioned at least 100, but usually much larger. If 
the use has not provided enough storage, ADS will print the 
appropriate message and terminate the optimization. 


OBJ 


G(NCON) 
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TABLE 5 CONCLUDED: PARAMETERS IN THE ADS ARGUMENT LIST 

PARAMETER DEFINITION 

NRWK Dimensioned size of work array MK. A good estimate is 

NRWK = 500 + 10*(NDV+NCON) + NC0LA*(NC0LA+3) +N*(N/2+l). where 
N » MAX(NDV.NCOLA). 

IWK(NRIWK) User provided work array for integer variables. Array IWK is 
used to store internal scalar variables and arrays used by ADS. 
IWK must be dimensioned at least 200, but usually much larger. 
If the user has not provided enough storage, ADS will print the 
appropriate message and terminate the optimization. 

NRIWK Dimensioned size of work array IWK. A good estimate is 
NRIWK = 200 + NDV + NCON + N + MAX(N,2*NDV), where 
N » MAX(NDV,NC0LA). 


Over-Riding ADS Default Parameters 

Various internal parameters are defined on the first call to ADS 
which work well for the "average" optimization task. However, it is 
often desirable to change these in order to gain maximum utility of the 
program. This mode of operation is shown in Figures 2 and 3. After the. 
first call to ADS, various real and integer scalar parameters are stored 
in arrays WK and IWK respectively. Those which the user may wish to 
change are listed in Tables 6 through 9, together with their default 
values and definitions. If the user wishes to change any of these, the 
appropriate component of WK or IWK is simply re-defined after the first 
call to ADS. For example, if the relative convergence criterion, 
DELOBJ, is to be changed to 0.002, this is done with the FORTRAN 
statement; 

WK(12) = 0.002 

because WK(12) contains the value of DELOBJ. 
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TABLE 6: 
PARAMETER 

REAL PARAMETERS STORED 
LOCATION DEFAULT 

IN ARRAY VK 

MODULES WHERE 
ISTRAT lOPT 

USED 

lONED 

ALAMDZ 

1 

0.0 

5 



BETAMC 

2 

0.0 

7 



ctI 

3 

-0.03 


4,5 


CTL 

4 

-0.005 

— 

4,5 


CTLMIN 

5 

0.001 

— 

4,5 

_ 

CTMIN 

6 

0.01 



4,5 


DABALP2 

7 

0.0001 

— 

ALL 


DABOBJ 

8 

ABS(F0)/10000 

ALL 

. — 


DABOBM 

9 

ABS(F0)/1000 

ALL 

— . 


DABSTR 

10 

ABS(F0)/10000 

ALL 



DELALP3 

11 

0.005 

— 


1,2, 5, 6 

DELOBJ 

12 

0.001 

— 

ALL 


DELOBM 

13 

0.01 

ALL 


_ 

DELSTR 

14 

0.001 

ALL 



DLOBJl 

15 

0.1 

— 

ALL 


DL0BJ2 

16 

1000.0 

— 

ALL 

_ 

DXl 

17 

0.01 

— 

ALL 


DX2 

18 

0.2 

- 

ALL 


EPSPEN 

19 

-0.05 

2,3,4 


- 

EXTRAP 

20 

5.0 


_ 

ALL 

FDCH 

21 

0.01 

— 

ALL 


FDCHM 

22 

0.001 

— 

ALL 


GMULTZ 

23 

10.0 

8 



PSAIZ 

24 

0.95 

8 



RMULT 

25 

5.0 

1.5 


^ ' 

RMVLMZ 

26 

0.2 

6,7,8 



RP 

27 

10.0 

1,5 



RPMAX 

28 

l.OE+10 

1,5 

_ 


RPMULT 

29 

0.2 

1,5 

__ 


RPPMIN 

30 

l.OE-10 

2,3,4 


_■ 

RPPRIM 

31 

100.0 

2,3,4 



SCFO 

32 

1.0 

ALL 

ALL 

ALL 

SCLMIN 

33 

0.001 

ALL 

ALL 

ALL 

STOL 

34 

0.001 

— 

4,5 


THETAZ 

35 

0.1 

— 

4,5 


XMULT 

36 

2.618034 

- 


1,2, 3, 5, 6, 7 

ZRO 

37 

0.00001 

ALL 

ALL 

ALL 


1 If IOPT-4, CT— 0.1 

2 If I0NED=3 or 8, DABALP»0.001 

3 If IONED-3 or 8, DELALP-0.05 


NOTE: FO Is the objective function value for the initial design 
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TABLE 7: DEFINITIONS OF REAL PARAMETERS CONTAINED IN ARRAY WK 

PARAMETER DEFINITION 


ALAMDZ 

BETAMC 

CT 

CTL 

CTLMIN 

CTMIN 

DAB ALP 
DABOBJ 

DABOBM 

DABSTR 

DELALP 

DELOBJ 

DELOBM 

DELSTR 

DLOBJl 

DLOBJ2 

DXl 

DX2 

EPSPEN 

EXTRAP 


Initial estimate of the Lagrange Multipliers in the Augmented 
Lagrange Multiplier Method. 

Additional steepest descent fraction in the method of centers. 
After moving to the center of the hypersphere, a steepest 
descent move is made equal to BETAMC times the radius of the 
hypersphere. 

Constraint tolerance in the Method of Feasible Directions or 
the Modified Method of Feasible directions. A constraint is 
active if its numerical value is more positive than CT. 

Same as CT, but for linear constraints. 

Same as CTMIN, but for linear constraints. 

Minimum constraint tolerance for nonlinear constraints. If a 
constraint is more positive than CTMIN, it is considered to 
be violated. 

Absolute convergence criteria for the one-dimensional search 
when using the Golden Section method. 

Maximum absolute change in the objective between two 
consecutive iterations to indicate convergence in 
optimization. 

Absolute convergence criterion for the optimization sub- 
problem when using sequential minimization techniques. 

Same as DABOBJ, but used at the strategy level. 

Relative convergence criteria for the one-dimensional search 
when using the Golden Section method. 

Maximum relative change in the objective between two 
consecutive iterations to indicate convergence in 
optimization. 

Relative convergence criterion for the optimization sub- 
problem when using sequential minimization techniques. 

Same as DELOBJ, but used at the strategy level. 

Relative change in the objective function attempted on the 
first optimization iteration. Used to estimate initial move 
in the one-dimensional search. Updated as the 
optimization progresses. 

Absolute change in the objective function attempted on the 
first optimization iteration. Used to estimate initial move 
in the one— dimensional search. Updated as the 
optimization progresses. 

Maximum relative change in a design variable attempted on the 
first optimization iteration. Used to estimate the initial 
move in the one-dimensional search. Updated as the 
optimization progresses. 

Maximum absolute change in a design variable attempted on the 
first optimization iteration. Used to estimate the initial 
move in the one-dimensional search. Updated as the 
optimization progresses. 

Initial transition point for extended penalty function 
methods. Updated as the optimization progresses. 

Maximum multiplier on the one-dimensional search parameter, 
ALPHA in the one-dimensional search using polynomial 
interpolation/ extrapolation. 
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TABLE 7 CONCLUDED: DEFINITIONS OF REAL PARAMETERS CONTAINED IN ARRAY HK 

PARAMETER DEFINITION 


FDCH 

FDCHM 


GMULTZ 

PSAIZ 

RMULT 

RMVLMZ 


RP 

RPMAX 

RPMULT 

RRPMIN 

RPPRIM 

SCFO 


Relative finite difference step when calculating gradients* 
Minimum absolute value of the finite difference step when 
calculating gradients* This prevents too small a step when 
X(I) is near zero* 

parameter in Sequential Quadratic programming* 
Move fraction to avoid constraint violations in Sequential 
Quadratic Programming* 

Penalty function multiplier for the exterior penalty function 
method* Must be greater than 1*0* 

J^filative move limit* Used to set the move limits in 
sequential linear programming, method of inscribed, 
hyperspheres and sequential quadratic programming as a 
fraction of the value of X(I), 1=1, NDV* 

Initial penalty parameter for the exterior penalty function 
method or the Augmented Lagrange Multiplier method* ■ 

Maximum value of RP for the exterior penalty function method 
or the Augmented Lagrange Multiplier method* 

Multiplier on RP for consequtlve iterations* 

Minimum value of RPPRIM to indicate convergence* 

Initial penalty parameter for extended interior penalty 
function methods* 

The user-supplied value of the scale factor for the objective 
function if the default or calculated value is to be over- 
ridden* 


SCLMIN Minimum numerical value of any scale factor allowed* 

STOL Tolerance on the components of the calculated search direction 
to indicate that the Kuhn-Tucker conditions are satisfied* 
THETAZ Nominal value of the push-off factor in the Method of Feasible 
Directions. 

XMULT Multiplier on the move parameter, ALPHA, in the one- 
dimensional search to find bounds on the solution* 

ZRO Numerical estimate of zero on the computer* Usually the 

default value is adequate* If a computer with a short word 
length is used, ZR0=1*0E— 4 may be preferred* 


TABLE 8: INTEGER PARAMETERS STORED IN ARRAY IWK 


MODULES WHERE USED 

PARAMETER LOCATION DEFAULT ISTRAT lOPT lONED 


ICNDIR 

1 

NDV+1 

— 

ALL 


ISCAL 

2 

1 

ALL 

ALL 

ALL 

ITMAX 

3 

40 

— 

ALL 


ITRMOP 

4 

3 

— 

1,2,3 


ITRMST 

5 

2 

ALL 



JONED 

6 

lONED 

8 



JTMAX 

7 

20 

ALL 

— 
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TABLE 9: DEFINITIONS OP INTEGER PARAMETERS CONTAINED IN ARRAY IHK 

PARAMETER DEFINITION 


ICNDIR 

ISCAL 

ITMAX 

ITRMOP 

ITRMST 

JONED 

JTMAX 


Restart parameter for conjugate direction and variable metric 
methods. Unconstrained minimization is restarted with a 
steepest descent direction every ICNDIR iterations. 

Scaling parameter. If ISCAL°0, no scaling is done. If 
ISCAL=1, the design variables, objective and constraints are 
scaled automatically. , ; 

Maximum number of iterations allowed at the optimizer level. 
The number of consecutive iterations for which the absolute or 
relative convergence criteria must be met to indicate 
convergence at the optimizer level. 

The number of consecutive iterations for which the absolute or 
relative convergence criteria must be met to indicate 
convergence at the strategy level. 

The one-dimensional search parameter (lONED) to be used in the 
Sequential Quadratic Programming method at the strategy level. 
Maximum number of iterations allowed at the strategy level. 


4.4 User-Supplied Gradients 

If it is convenient to supply analytic gradients to ADS, rather 
than using Internal finite difference calculations, considerable 
optimization efficiency is attainable. If the user wishes to supply 
gradients, the flow logic given in Figure 3 is used. In this case, the 
information parameter, INFO, will be returned to the user with a value 
of INF0=2 when gradients are needed. The user calculates the NGT 
gradients of the constraints identified by array IC and stores these in 
the first NGT columns of array A. That is column I of A contains the 
gradient of constraint J, where J=IC(I), . 


4.5 Restarting ADS 

When solving large and complex design problems, or when multi-level 
optimization is being performed, it is often desirable to terminate the 
optimization process and restart from that point at a later time. This 
is easily accomplished using the ADS program. Figure 4 provides the 
basic flowchart for this process. Whenever control is returned fron ADS 
to the calling program, the entire contents of the parameter list are 
written to disk (or a file in a database management system). The 
program is then stopped at this point. Later, the program is restarted 
by reading the Information back from disk and continuing from this 
point. If optimization is performed as -a sub-problem within analysis, 
the information from the system level optimization is written to disk 
and the analysis is called. The analysis module can then call ADS to 
perform the sub-optimization task. Then, upon return from analysis, the 
system level information is read back from storage and the optimization 
proceeds as usual. From this, it is seen that considerable flexibility 
exists for multi-level and multi-discipline optimization with ADS, where 
the ADS program is used for multiple "tasks within the overall design 
process. 


15 



The user may wish to stop the optimization at specific times during 
the process* The parameter IMAT is array IWK gives general information 
regarding the progress of the optimization. Appendix B provides details 
of this parameter as well as other parameters stored in WK and IWK which 
may be useful to the experienced user of ADS. 


BEGIN 


I 



Figure 4: Restarting ADS 


4*6 Choosing An Algorithm 

One difficulty with a program such as ADS, which provides numerous 
options, is that of picking the best combination of algorithms to solve 
a given problem. While it is not possible to provide a concise set of 
rules, some general guidelines are offered here based on the author's 
experience. The user is strongly encouraged to try many different 
options in order to gain familiarity with ADS and to improve the 
probability that the best combination of algorithms is found for the 
particular class of problems being solved. 
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UNCONSTRAINED FUNCTIONS (NCON-0, Side Constraints OK) 
ISTRAT=0 


Is computer storage very limited? 

Yes — I0PT=1. Are function evaluations expensive? 

Yes “ Is the objective known to be approximately quadratic? 
Yes - IONED-4 
No - IONED-3 
No - IONED-1 or 2 


No - Is the analysis iterative? 

Yes — I0PT=3. Are function evaluations expensive? 

Yes - Is the objective known to be approximately quadratic? 

Yes - I0NED=4 
No - I0NED=3 
No - IONED-1 or 2 

No — I0PT=2 or 3. Are function evaluations expensive? 

Yes - Is the objective known to be approximately quadratic? 

Yes - IONED-4 
No - I0NED=3 


No - I0NED=1 or 2 


CONSTRAINED FUNCTIONS (NC0N>0) 


Are relative minima known to exist? 

Yes - ISTRAT=1, I0PT*»3. Are function evaluations expensive? 
Yes - IONED-3 

No - I0NED=1 or 2 


No 


- Are the objective and/or constraints highly nonlinear? 
Yes — Are function evaluations expensive? 

Yes - ISTRAT=*0, I0PT=4, I0NED=7 


No 


No - ISTRAT=2, 3 or 5, I0PT=2 or 3, I0NED=1 or 2 
- Is the design expected to be fully-constrained? 
(i.e. NDV active constraints at the optimum) 

Yes - ISTRAT-6, IOPT-5, IONED-6 
No - Is the analysis Iterative? 


Yes - ISTRAT=0, 
ISTRAT-8, 
No - ISTRAT-0, 
ISTRAT-8, 


I0PT»4, I0NED=7 or 
IOPT-5, I0NED=7 
I0PT=5, I0NED=7 or 
I0PT=5, I0NED=7 


GENERAL APPLICATIONS 

Often little is known about the nature of the problem being solved. 
Based on experience with a wide variety of problems^ a very direct 
approach is given here for using ADS. The following table of parameters 
is offered as a sequence of algorithms. When using ADS the first few 
times, the user may prefer to run the cases given here, rather than 
using the decision approach given above. It is assumed here that 
a constrained optimization problem is being, solved. If the problem is 
unconstrained, ISTRAT»0, IOPT-3 and IONED-2 or 3 is recommended. 
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ISTRAT 

lOPT 

lONED 

IPRINT 

8 

5 

7 

2200 

0 

5 

7 

2020 

0 

4 

7 

2020 

6 

5 

6 

2200 

5 

3 

3 

2200 

2 

3 

3 

2200 

1 

3 

3 

2200 


5.0 

EXAMPLES 



Consider the following two-variable optimization problem with two 
nonlinear constraints: 


Minimize 

OBJ — 2 + A 2 

Subject to; 

Gfl'> = 2 Ai + J 2 A 2 


2Ai[Ai + J 2 A 2 ] 


G(2) = 1 


2[Aj^ + ^A2] 


0,01 < Ai < l.OE+20 i=l,2 


This is actually the optimization of the classical 3— bar truss shown in 
Figure 5 where, for simplicity, only the tensile stress constraints in 
members 1 and 2 under load are included. The loads, and P 2 , are 
applied separately and the material specific weight is 0.1 lb. per cubic 
inch. The structure is required to be symmetric so X(l) corresponds to 
the cross-sectional area of members 1 and 3 and X(2) corresponds tp the 
cross-sectional area of member 2. 





Pi = 20000 lb. ?2 = 20000 lb. 

Figure 5: Three-Bar Truss 
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5.1 Example 1; All Default Parameters 

Figure 6 gives the FORTRAN program to be used with ADS to solve 
this problem. Only one line of data is read by this program to define 
the values of ISTRAT, lOPT, lONED and IPRINT and the FORMAT is 415. 
When the optimization is complete, another case may be run by reading a 
new set of data. The program terminates when ISTRAT=-1 is read as data. 

Figure 7 gives the results obtained with ISTRAT=0, I0PT=4, I0NED=7 
and IPRINT=1000. The reader is encouraged to experiment with this 
program using various combinations of the options from Table 4. 

5.2 Example 2; Initial Parameters Are Modified 

The 3-bar truss designed in Section 5.1 is now designed with the 
following changes in the internal .parameters: 


Parameter New Value Location in WK Location in IWK 


CT -0.1 
CTMIN 0.002 
THETAZ 1.0 
ITRMOP 2 



The FORTRAN program- used here is shown in Figure 8 and the results 
are given in Figure 9. 


5.3 Example 3; Gradients Supplied by the User 

The 3-bar truss designed in Sections 5.1 and 5.2 is designed here 
with user-supplied gradients. The parameters CT, CTMIN, CTMIN, THETAZ 
and ITRMOP are over-ridden as in Section 5.2. Also, . now IPRINT=2020 to 
provide a more typical level of optimization output. 

The FORTRAN program associated with this example is given in 
Figure 10. Figure 11 gives the results. 
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C SIMPLIFIED USAGE OF ADS. THE THREE-BAR TRUSS. 

C REQUIRED ARRAYS. 

. DIMENSION X(3),VLB(3),VUB(3),G(2),IDG(2),IC(2),DF(3),A(2,2), 

1 WK(1000),IWK(500) 

C ARRAY DIMENSIONS. 

NRA=2 
NCOLA-2 
NRWK=1000 
NRIWK=500 
C PARAMETERS. 

IGRAD=0 

NDV=2 

NCON=«2 

C INITIAL DESIGN. 

X(l)=l. . 

X(2)=l. 

C BOUNDS. 

VLB(1)=.01 

VLB(2)=.01 

VUB(l)=1.0E+20 

VUB(2)=1.0E+20 

C IDENTIFY CONSTRAINTS AS NONLINEAR, INEQUALITY. 

IDG(1)=0 
IDG(2)=0 
C INPUT. 

READ (5, 30) ISTRAT,IOPT,IONED,IPRINT 
C OPTIMIZE. 

INFO-0 

10 CALL ADS (INFO, ISTRAT,IOPT,IONED,IPRINT,IGRAD,NDV,NCON,X, VLB, 

1 VUB,OBJ,G,IDG,NGT,IC,DF,A,NRA,NCOLA,WK,NRWK,IWK,NRIWK) 

IF (INFO.EQ.O) GO TO 20 
C EVALUATE OBJECTIVE AND CONSTRAINTS. 

0BJ=2.*SQRT(2.)*X(1)+X(2) 

G(1)=(2.*X(1)+SQRT(2.)*X(2))/(2.*X(1)*X(1)+SQRT(2.)*X(2)))-1. 

G(2)=.5/(X(1)+SQRT(2.)*X(2))-1. 

C GO CONTINUE WITH OPTIMIZATION. 

GO TO 10 
20 CONTINUE 

C PRINT RESULTS. 

WRITE(6,40) OBJ,X(l),X(2),G(l),G(2) 

STOP 

30 FORMAT (415) 

40 FORMAT (//5X,7HOPTIMUM,5X,5HOBJ =,E12.5//5X,6HX(1) =,E12.5,5X, 

1 6HX(2) »,E12.5/5X,6HG(1) =,E12.5,5X,6HG(2) =,E12.5) 

END 


Figure 6: Example 1; All Default Parameters 
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AAAAA DDDDDD SSSSSS 
A A D D S 

A AD D S 

AAAAAAA D D SSSSS 
A A D D S 

A ADD S 

A A DDDDDD SSSSSS 


FORTRAN PROGRAM 
FOR 

A U T 0 M ATED DESIGN SYNTHESIS 
VERSIONl.OO 


CONTROL PARAMETERS 

ISTRAT = 0 lOPT = 4 lONED = 7 IPRINT = 1000 

IGRAD = 0 NDV =» 2 NCON = 2 


OPTIMIZATION RESULTS 


OBJECTIVE FUNCTION VALUE' 0.26279E+01 


DESIGN VARIABLES 

LOWER 

VARIABLE BOUND VALUE 

1 O.lOOOOE-01 0.78131E+00 

2 O.lOOOOE-01 0.41804E+00 


DESIGN CONSTRAINTS 

1) 0.4248E-02 -0.6357E+00 

FUNCTION EVALUATIONS - 55 


OPTIMUM OBJ = 0.26279E+01 

X(l) = 0.78131E-K)0 X(2) « 0.41804E+00 

G(l) » 0.42477E-02 G(2) — 0.63570E+Q0 

Figure 7: Example 1; Output 


UPPER ■ 
BOUND 

O.lOOOOE+21 

O.lOOOOE+21 
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C USAGE OF ADS. OVER-RIDING DEFAULT PARAMETERS. 

C THE THREE-BAR TRUSS. 

C REQUIRED ARRAYS. 

DIMENSION X(3),VLB(3),VUB(3),G(2),IDG(2),IC(2),DF(3),A(2,2), 

1 WK( 1000 ),IWK( 500) 

C ARRAY DIMENSIONS. 

NRA=2 
■ NC0LA=2 
NRWK=1000 
NRIWK=500 
C PARAMETERS. 

IGRAD=0 ( 

NDV“2 

NCON-2 

C INITIAL DESIGN. 

X(l)=l. 

X(2)=l. 

C BOUNDS. 

VLB(1)=.01 

VLB(2)=.01 

VUB(l)=1.0E+20 

VUB(2)=1.0E+20 

C IDENTIFY CONSTRAINTS AS NONLINEAR, INEQUALITY. 

IDG(1)=0 
IDG(2)=0 
C INPUT. 

READ(5,30) ISTRAT,IOPT,IONED,IPRINT 
C INITIALIZE INTERNAL PARAMETERS. 

INFO=-2 

CALL ADS (INFO, ISTRAT,IOPT,IONED,IPRINT,IGRAD,NDV,NCON,X, VLB, 

1 VUB,OBJ,G,IDG,NGT,IC,DF,A,NRA,NCOLA,WK,NRWK,IWK,NRIWK) 

C OVER-RIDE DEFAULT VALUES OF CT, CTMIN, THETAZ AND ITEIMOP. 

WK(3)— 0.1 
WK(6)=0.002 
WK(35)=1.0 
IWK(4)=2 
C OPTIMIZE. 

10 CALL ADS (INFO, ISTRAT,IOPT,IONED,IPRINT,IGRAD,NDV,NCON,X, VLB, 

1 VUB,OBJ,G,IDG,NGT,IC,DF,A,NRA,N.COLA,WK,NRWK,IWK,NRIWK) 

IF (INFO.EQ.O) GO TO 20 
C EVALUATE OBJECTIVE AND CONSTRAINTS. 

OB J-2 . *SQRT ( 2 . ) *X( 1 )+X( 2 ) 

G(l)=(2.*X(l)+SQRT(2.)*X(2))/(2.*X(l)*xa)+SQRT(2.)*X(2)))-l. 

G(2)=*.5/(X(1)+SQRT(2.)*X(2))-1. 

C GO CONTINUE WITH OPTIMIZATION. 

GO TO 10 
20 CONTINUE 

C PRINT RESULTS. 

WRITE(6,40) 0BJ,X(1),X(2),G(1),G(2) 

STOP 

30 FORMAT (415) 

40 FORMAT (//5X,7HOPTIMUM,5X,5HOBJ -,E12.5//5X,6HX(1) -,E12.5,5X, 

1 6HX(2) -,E12.5/5X,6HG(1) -,E12.5,5X,6HG(2) »,E12.5) 

END 

Figure 8; Example 2; Modify Default Parameters 
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AAAAA DDDDDO SSSSSS 
A ADDS 
A AD D S 

AAAAAAA D D SSSSS 
A A D D S 

A A D D S 

A A DDDDDD SSSSSS 


FORTRAN PROGRAM 
FOR 

AUTOMATED DESIGN SYNTHESIS 
VERSION 1.00 


CONTROL PARAMETERS 

ISTRAT = 0 lOPT = 4 lONED = 7 IPRINT = 1000 

IGRAD = 0 NDV = 2 NCON = 2 


OPTIMIZATION RESULTS 


OBJECTIVE FUNCTION VALUE 0.26396E+01 


DESIGN VARIABLES 

UPPER 

VALUE BOUND 

0.78786E+00 O.lOOOOE+21 
0.41121E+00 O.lOOOOE+21 


DESIGN CONSTRAINTS 

1) -0.2431E-03 -0.6349E+00 
FUNCTION EVALUATIONS » 20 


OPTIMUM OBJ - 0.26396E+01 

X(l) = 0.78786E+00 X(2) - 0.41121E+00 

G(l) “-0.24313E-03 G(2) =-0.63488E+00 

Figure 9: Example 2; Output 


LOWER 

VARIABLE BOUND 

1 O.lOOOOE-01 

2 O.lOOOOE-01 
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C USAGE OF ADS. OVER-RIDING DEFAULT PARAMETERS, AND PROVIDING 

C GRADIENTS. THE THREE-BAR TRUSS. 

C REQUIRED ARRAYS. 

DIMENSION X(3),VLB(3),VUB(3),G(2),IDG(2),IC(2),DF(3),A(2,2), 
1 WK( 1000 ),IWK( 500) 

DIMENSION B(2,2) 

C ARRAY DIMENSIONS. ' - 

NRA=2 • _ 

NC0LA=2 
NRWK=1000 
NRIWK=500 
C PARAMETERS. 

IGRAD=0 

NDV=2 

NC0N=2 

C INITIAL DESIGN. 

X(l)-1. 

X(2)=l. 

C BOUNDS. 

VLB(1)-.01 

VLB(2)=.01 

VUB(l)-1.0E+20 

VUB(2)=1.0E+20 

C IDENTIFY CONSTRAINTS AS NONLINEAR, INEQUALITY. 

IDG(1)=0 
IDG(2)=0 
C INPUT. 

READ (5, 30) ISTRAT,IOPT,IONED,IPRINT 
C INITIALIZE INTERNAL PARAMETERS. 

INFO=— 2 

CALL ADS (INFO, ISTRAT,IOPT,IONED,IPRINT,IGRAD,NDV,NCON,X, VLB, 
1 VUB,OBJ,G,IDG,NGT,IC,DF,A,NRA,NCOLA,WK,NRWK,IWK,NRIWK) 

C OVER-RIDE DEFAULT VALUES OF CT, CTMIN, THETAZ AND ITRM)P. 

WK(3)=-0.1 
WK(6)=0.002 
WK(35)=1.0 
IWK(4)=2 
C OPTIMIZE. 

10 CALL ADS (INFO, ISTRAT,IOPT,IONED,IPRINT,IGRAD,NDV,NCON,X, VLB, 

1 VUB , OB J , G , IDG , NGT , IC , DF., A, NRA, NCOLA , WK , NRWK , IWK , NRIWK) 

IF (INFO.EQ.O) GO TO 60 
IF (INFO.GT.l) GO TO 20 
C EVALUATE OBJECTIVE AND CONSTRAINTS,. ' ' 

OBJ=*2.*SQRT(2.)*X(l)+X(2)' 

G(l)=(2.*X(l)+SQRT(2.)*X(2))/(2.*xa)*X(l)+SQRT(2.)*X(2)))-l. 

G(2)=.5/(X(1)+SQRT(2.)*X(2))-1. 

C GO CONTINUE WITH OPTIMIZATION. 

GO TO 10 


Figure 10: Example 3; Gradients Supplied by the User 
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20 CONTINUE 

C GRADIENT OF OBJ. 

DF(1)=2.*SQRT(1.) 

DF(2)=1.0 

IF (NGT.EQ.O) GO TO 10 

C CONSTRAINT GRADIENTS. USE ARRAY B FOR TEMPORARY STORAGE. 

D1=(X( 1 )+SQRT(X(2) )**2 
C G(l). 

B(1,1)=-(2.*X(1)*X(1)+2.*SQRT(2.)*X(1)*X(2)+SQRT(2.)*X(2)*X(2)/ 
1 (2.*X(1)*X(1)*D1) 

B(2,1)=-1./(SQRT(2.)*D1) 

C G(2). 

B(l,2)— 0.5/Dl 
B(2,2)-SQRT(2.)*B(1,2) 

C STORE APPROPRIATE GRADIENTS IN ARRAY A. 

DO 30 J=1,NGT 
K=IC(J) 

A(1,J)=B(1,K) 

30 A(2,J)=B(2,K) 

GO TO 10 
60 CONTINUE 

C PRINT RESULTS. 

WRITE(6,40) 0BJ,X(1),X(2),G(1),G(2) 

STOP 

30 FORMAT (4I5) 

40 FORMAT (//5X,7H0PTIMUM,5X,5H0B J =,E12.5//5X,6HX(1) =,E12.5,5X, 

1 6HX(2) =,E12.5/5X,6HG(1) =,E12.5,5X,6HG(2) =,E12.5) 

END 


Figure 10 Concluded; Example 3; Gradients Supplied by the User 
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AAAAA 
A A 

A A 

AAAAAAA 
A A 

A A 

A A 


DDDDDD 
D D 


D 
D 
D 
D 

DDDDDD 


SSSSSS 


S 

S 


SSSSS 


S 

S 


SSSSSS 


fortran program 

FOR 

automated design synthesis 
versioni.oo 


CONTROL PARAMETERS 
ISTRAT =■ 0 lOPT = 

IGRAD = 1 NDV 31 

SCALAR PROGRAM PARAMETERS 
REAL PARAMETERS 


1) 

ALAMDZ 

sr 

0.0 

2) 

BETAMC 

=3 

0.0 

3) 

CT 

3 

-O.IOOOOE+OO 

4) 

CTL 

= 

-0.50000E-02 

5) 

CTLMIN 

a 

O.lOOOOE-02 

6) 

CTMIN 

n 

0.20000E-02 

7) 

DAB ALP 

tm 

O.lOOOOE-03 

8) 

DABOBJ 

aa 

0.38284E-03 

9) 

DABOBM 

= 

0.38284E-03 

10) 

DABSTR 

3 

0.38284E-03 

11) DELALP 

= 

0.50000E-02 

12) 

DELOBJ 

s 

O.lOOOOE-02 

13) 

DELOBM 

3 

0.50000E-04 

14) 

DELSTR 

S2 

O.lOOOOE-02 

15) DLOBJl 

S 

0. lOOOOE+00 

16) 

DL0BJ2 

3 

O.lOOOOE+04 

17) 

DXl 

= 

O.lOOOOE-01 

18) 

DX2 

= 

0.20000E+00 

19) EPSPEN 

3 

•-0.50000E-01 


INTEGER PARAMETERS 

1) ICNDIR = 3 

2) ISCAL = 1 

3) ITMAX = 40 


4 lONED 

2 NCON 


20) EXTRAP 

21) FDCH 

22) FDCHM 

23) GMULTZ 

24) PSAIZ 

25) RMULT 

26) RMVLMZ 

27) RP 

28) RPMAX 

29) RMULT 

30) RPPMIN 

31) RPPRIM 

32) SCFO 

33) SCLMIN 

34) STOL 

35) THETAZ ^ 

36) XMULT i 

37 ) ZRO 


7 IPRINT 
2 


0.50000E+01 

O.IOOOOE-Ol 

O.lOOOOE-02 

O.lOOOOE+02 

0.95000E+00 

0.50000E+01 

0.20000E+00 

O.lOOOOE+02 

O.lOOOOE+09 

0.20000E+00 

O.lOOOOE-07 

O.lOOOOE+03 

O.lOOOOE+01 

O.lOOOOE-02 

O.lOOOOE-02 

O.lOOOOE+01 

0.26180E+01 

O.lOOOOE-04 


4) ITRMOP 

5) ITRMST 


2 

2 


6) JONED 

7) JTMAX 


Figure 11; Example 3 - Output 


= 2020 


7 

20 
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ARRAY STORAGE REQUIREMENTS 

DIMENSIONED REQUIRED 
ARRAY SIZE SIZE 

WK 1000 197 

IWK 500 184 


lOPT = 4; METHOD OF FEASIBLE DIRECTIONS 


— INITIAL DESIGN 

OBJ " 0.38284E+01 

DECISION VARIABLES (X-VECTOR) 

1) O.lOOOOE+01 O.lOOOOE+01 

LOWER BOUNDS ON THE DECISION VARIABLES (VLB-VECTOR) 
1) O.lOOOOE-01 O.lOOOOE-01 

UPPER BOUNDS ON THE DECISION VARIABLES (VUB-VECTOR) 
1) O.lOOOOE+21 O.lOOOOE+21 

CONSTRAINT VALUES (G-VECTOR) 

1) -0.31371E+00 -0.17040E+0,1 


— ITERATION 1 OBJ = 0.'26874E+01 

DECISION VARIABLES (X-VECTOR) 

1) 0.71816E+00 O.65616E+0O 

— ITERATION 2 OBJ = 0.26398E+01 

DECISION VARIABLES (X-VECTOR) 

1) 0.79473E+00 0.39196E+00 

FINAL OPTIMIZATION RESULTS 

NUMBER OF ITERATIONS » 3 

OBJECTIVE =■ 0.26398E+01 - 

DECISION VARIABLES (X-VECTOR) 

1) 0.79473E+00 0.39196E+00 

CONSTRAINT VALUES (G-VECTOR) 

1) -0.23724E-03 -0.13526E+01 ' 

CONSTRAINT TOLORANCE, CT = -O.lOOOOE+00 CTL = -0.50000E-02 

Figure 11 Continued: Example 3 - Output 
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THERE ARE 1 ACTIVE CONSTRAINTS AND 0 
CONSTRAINT NUMBERS 
1 

THERE ARE 0 ACTIVE SIDE CONSTRAINTS 
TERMINATION CRITERIA 

KUHN-TUCKER PARAMETER, BETA = 0.70453E-04 


VIOLATED CONSTRAINTS 


IS LESS THAN O.lOOOOE-0 


OPTIMIZATION RESULTS 


OBJECTIVE FUNCTION VALUE 0.26398E+01 
DESIGN VARIABLES 


LOWER 

VARIABLE BOUND 

1 O.lOOOOE-01 

2 O.lOOOOE-01 


UPPER 

VALUE BOUND 

0.79473E+00 O.lOOOOE+21 
0.39196E+00 O.IOOOOE+21 


design CONSTRAINTS 

1) -0.2215E-03 -0.6294E+00 
FUNCTION EVALUATIONS =8 
GRADIENT EVALUATIONS =» 3 

OPTIMUM OBJ = 0.26398E+01 

X(l) = 0.79473E+00 X(2) - 0.39196E+00 

G(l) =-0.22149E-03 G(2) — 0.62937E+00 


Figure ll Concluded; Example 3; Output 


llO M^ PROGRAM FOR SIMPLIFIED USAGE OF ADS 

Tho ® general-purpose calling program for use with ADS. 

Vk? sufficient to solve problems of up to 20 

constraints. Arrays IC and A are dlmeLloned 

mark (?) 1^ 30 constraint gradients. Wherever a question 

mark (?) is given, It Is understood that the user will supply the 
appropriate^ Information. Note that the statement X(I)»?, I=1,NDV Is not 

simply denotes that the value of the NDV 
design variables must be defined here. 
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Subroutine EVAL is the user-supplied subroutine for evaluating 
functions and gradients (if user-supplied). 

Subroutine EVAL has the following call statement: 

CALL EVAL (INFO, NDV,NCON, OBJ, X,G,DF,NGT,IC,A,NRA) 

The parameters INFO, NDV, NCON, X, NGT, IC and NRA are input to 
Subroutine EVAL, while OBJ, G, DF and A are output. Depending on the 
user needs, this may be simplified. For example, if IGRAD**0 and NDV and 
NCON are not required by the analysis, the calling statement may be 

CALL EVAL (OBJ,X,G) 

Alternatively, INFO may be used as a print control so, after the 
optimization is complete, INF0**3 is sent to EVAL to indicate that 
analysis information should be printed. Note however, that during 
optimization, the value of INFO returned from ADS must be the same when 
calling ADS to continue optimization (eg. it may be safer to use another 
user-defined parameter as a print control). 


C SIMPLIFIED USAGE OF THE ADS OPTIMIZATION PROGRAM. 

DIMENSION X(21),VLB(21),VUB(21),G(100),IDG(100),IC(30),DF(21), 

* A(21,30),WK(10000),IWK(2000) 

NRA=21 

NC0LA=30 
NRWK= 10000 
NRIWK=2000 

C INITIALIZATION. 

IGRAD-? 

NDV=? 

NC0N=? 

X(I)=?, 1=1, NDV 
VLB(I)=?, 1=1, NDV 

VUB(I)=?, 1=1, NDV 

IDG(I)=? 1=1, NCON 
ISTRAT-? 

I0PT=? 

I0NED=? 

IPRINT-? 

INF0=0 

10 CALL ADS (INFO, ISTRAT,I0PT,I0NED,IPRINT,IGRAD, NDV, NCON, X, 

* VLB,VUB,OBJ,G,IDG,NGT,IC,DF,A,NRA,NCOLA,WK,NRWK,IWK,NRIWK) 
CALL EVAL (INFO, NDV, NCON, OBJ, X,G,DF, NGT, IC,A,NRA) 

IF (INFO.GT.O) GO TO 10 

C OPTIMIZATION IS COMPLETE. PRINT RESULTS. 

STOP 

END 

Figure 12: Program for Simplified Usage of ADS 
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appendix a 

QmCK REFERENCE TO ADS OPTIONS 



OPTIMIZER 
Fletcher-Reeves 
Davidon-Fletcher-Powell (DFP) 

Broy don-F le tcher-Goldf arb-Shanno ( BFGS ) 
Method of Feasible Directions 
Modified Method of Feasible Directions 


STRATEGY 




ISTRAT lOPT 1 


2 


None 

SUMT, Exterior 

SUMT, Linear Extended Interior 
SUMT, Quadratic Extended Interior 
SUMT, Cubic Extended Interior 
Augmented Lagrange Multiplier Meth. 
Sequential Linear Programming 
Method of Centers 
Sequential Quadratic Programming 


0 

1 

2 

3 

4 

5 

6 

7 

8 


X 

X 


0 


X 

X 

X 

X 

X 

X 

0 

0 

0 


ONE-DIMENSIONAL SEARCH 


lONED 


Golden Section Method 
Golden Section + Polynomial 
Polynomial Interpolation (bounded) 
Polynomial Extrapolation 
Golden Section Method 
Golden Section + Polynomial 
Polynomial Interpolation (bounded) 
Polynomial Extrapolation 


1 

2 

3 

,4 

5 

6 

7 

8 


X 

X 

X 

X 

0 

0 

0 

0 


X 

X 

X 

X 

0 

0 

0 

0 


X 

X 

X 

X 

X 

X 

0 

0 

0 


X 

X 

X 

X 

0 

0 

0 

0 


4 


X 

0 

0 

0 

0 

0 

X 

X 

X 


0 

0 

0 

0 

X 

X 

X 

X 


if 

5 


X 

0 

0 

0 

0 

0 

X 

X 

X 


0 

0 

0 

0 

X 

X 

X 

X 


NOTE: An X denotes an allowed cbmblhatlon of algorithms. 
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APPENDIX B 


USEFUL INFORMATION STORED IN ARRAYS WK AND IWK 


Arrays WK and IWK contain Information calculated by ADS which Is 
sometimes useful In monlterlng the progress of the optimization. Tables 
B-1 and B-2 Identify parameters which may be of Interest to the user. 
Note that these parameters must not be changed by the user during the 
optimization process. 


TABLE B-1: REAL PARAMETERS STORED IN ARRAY WK 

PARAMETER LOCATION DEFINITION 


ALPHA 

52 

ALPHA3 

53 

PENALT 

82 

SLOPF 

85 


Move parameter In the one-:dlmenslonal search. 
Alpha at the strategy level for ISTRAT*8. 

The value of the penalty In SUMT methods. 

The slope of the OBJ versus ALPHA function In the 
one-dlmenslonal search. 
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TABLE B-2: INTEGER PARAMETERS STORED IN ARRAY IWK 

PARAMETER LOCATION DEFINITION 


IDAB 

23 

IDAB3 

24 

IDEL 

25 

IDEL3 

26 

IFCALL 

28 

IGCALL 

29 

IMAT 

34 


ITER 

45 

JTER 

46 

LGOTO 

54 


NAC 

58 

NAGS 

59 

NVC 

68 

NXFD 

69 


Number of consecutive times the absolute 
convergence criterion has been satisfied at the 
optimization level. 

Same as IDAB, but at the strategy level. 

Number of consecutive times the relative 
convergence criterion has been satisfied at the 
optimization level. 

Same as IDEL, but at the strategy level. 

The number of times the objective and constraint 
functions have been evaluated. 

The number of times analytic gradients have been 
evaluated. 

Pointer telling the status of the optimization 
process. 

0 - Optimization is complete. 

1 Initialization is complete and control is being 
returned to the user to over-ride default 
parameters. 

2 - Initial function evaluation. 

3 - Calculating analytic gradients. 

4 - Calculating finite difference gradients. NXFD 

identifies the design variable being changed. 

5 - One-dimensional search is being performed. 

See LGOTO. 

Iteration number at the optimization level. 
Iteration number at the strategy level. 

Location in one— dimensional search. 

1 - Finding bounds on the solution. 

2 - Golden Section method. 

3 - Polynomial interpolation after Golden Section. 

4 - Polynomial interpolation after getting bounds. 

5 — Polynomial interpolation/extrapolation. 

Number of active constraints. 

Number of active side constraints. 

Number of violated constraints. 

Design variable being perturbed during finite 
difference gradients. 
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APPENDIX C 


SUBROUTINES NEEDED FOR A SPECIFIED COMBINATION OF ISTRAT, lOPT A^ lONEP 

Depending on the corobinstion of ISTRAT, lOPT end lONED, only a 
subset of subroutines contained in the ADS system are used. Therefore, 
if computer memory is limited, it may be desired only to load those 
routines which are actually used. This will result in unsatisfied 
externals" at run time, but on most systems the program can be executed 
anyway since the unsatisfied external routines are not actually called. 
Below is a list of the routines needed for a given combination of 
algorithms. In some cases, slightly more routines are included than are 
absolutely necessary, but they are short and a more precise list would 
be undully complicated. 

ALWAYS LOAD THE FOLLOWING SUBROUTINES; 

ADS, ADSOOl, ADS002, ADS004, ADS005, ADS006, ADS007, ADS009, ADSOlO, 

ADS102, ADS103, ADS105, ADS112, ADS122, ADS20;1, ADS206, ADS211, ADS216, 

ADS236, ADS401, ADS402, ADS403, ADS420, ADS503, ADS504, ADS506, ADS510 


STRATEGY LEVEL 

Depending on the value of ISTRAT, the following subroutines are 
also required: 

ISTRAT “ 0, No strategy routines are added. Go to the optimizer level. 

ISTRAT = 1, Add: ADS008, ADS301, ADS302, ADS508 

ISTRAT = 2, Add: ADS008, ADS302, ADS303, ADS308, ADS508 

ISTRAT - 3, Add; ADS008, ADS302, ADS304, ADS308, ADS508 

ISTRAT - 4, Add: ADS008, ADS302, ADS305, ADS308, ADS508 

ISTRAT » 5, Add: ADS008, ADS302, ADS306, ADS307, ADS508 

ISTRAT - 6, Add: ADS320, ADS321, ADS323, ADS333 

ISTRAT - 7, Add: ADS323, ADS330, ADS331, ADS333 

ISTRAT - 8, Add: ADS207, ADS217, ADS218, ADS221, ADS223, ADS310, ADS333, 
ADS371, ADS375, ADS376, ADS377, ADS378, ADS404, ADS507, 
ADS508, ADS509 
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OPTIMIZER LEVEL 


Depending on the value of lOPT, the following subroutines are also 
required: ' 

lOPT - 1, Add: ADS204, ADS213, ADS214, ADS509 

lOPT » 2, Add: ADS213, ADS214, ADS235, ADS404, ADS503, ADS509 

lOPT » 3, Add: ADS213, ADS214, ADS235, ADS404, ADS503, ADS509 

lOPT = 4, Add: ADS201, ADS205, ADS207, ADS217, ADS218, ADS221, ADS223, 

ADS507 

lOPT - 5, Add: ADS201, ADS202, ADS203, ADS207, ADS209, ADS217, ADS218, 
ADS221, ADS223, ADS235, ADS507 

ONE-DIMENSIONAL SEARCH LEVEL 

Depending on the value of lONED, the following subroutines are also 
required: 

lONED - 1-4, Add: ADS116, ADS117, ADS118, ADS121, ADS126, ADS127 

lONED » 5-8, Add: ADSlOl, ADS104, ADS106, ADS108, ADS109, ADSllO, 

ADSlll, ADS115, ADS119, ADS123, ADS124, ADS125, 

ADS502 
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APPENDIX D 


ADS SYSTEM SUBROUTINES 


The subroutines in the ADS system are listed here with a very brief 
description of each. Most subroutines are Internally documented, and 
the user is referred to the program listing for more details. 

Generally, ADS001-ADS099 are control level routines. ADSIOI- 
ADS199 are one-dlmenslonal search level routines, ADS201-ADS29 9 are 
optimization level routines and ADS301-ADS399 are strategy level 
routines. ADS401-ADS499 are print routines and ADS501-ADS599 are 
utility routines. 

ROUTINE PURPOSE 


ADS 

ADSOOl 
ADS002 
ADS003 
ADS004 
ADS005 
ADS006 
ADS007 
ADS008 
ADS009 
ADSOlO 
ADS 101 
ADS 102 
ADS103 
ADS104 
ADS105 
ADS 106 
ADS108 
ADS109 


- Main control routine for optimization. 

- Control one-dlmenslonal search level. 

- Control optimizer level. 

- Control strategy level. 

- Define work array storage allocations. 

- Initialize scalar parameters to their default values. 

- Initialize scale factors. 

- Calculate scale factors, scale, unscale. 

- Calculate gradients of pseudo-objective for ISTRAT“l-5. 

- Re-order IC and A arrays. 

- Calculates convergence criteria parameters. 

- Coefficients of linear polynomial. 

- Coefficients of quadratic polynomial. 

- Coefficients of cubic polynomial. 

- Zeroes of polynomial to third-order. 

- Minlmums of polynomial to third-order. 

- Evaluate n-th order polynomial. 

- Find minimum of a function by polynomial Interpolation. 

- Find zeroes of a function by polynomial interpolation. 
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ROUTINE 


PURPOSE 


ADSllO 

ADSlll 

ADS112 

ADS115 

ADS1I6 

ADS117 

ADS118 

ADS119 

ADS 121 
ADS122 
ADS123 
ADS124 

ADS125 

ADS126 

ADS127 

ADS 201 
ADS202 
ADS203 

ADS204 

ADS205 

ADS206 

ADS207 


- Evaluate slope of n-th order polynomial. 

- Polynomial Interpolation for constraint boundaries. 

- Find ALPMAX so NOV side constraints are encountered. 

- Control one-dimensional search for constrained functions. 

- Control one-dimensional search for unconstrained functions. 

- Polynomial Interpolation of unconstrained function, within 
bounds . 

- Polynomial interpolation of unconstrained function, no 
bounds given. 

- Polynomial interpolation of constrained function, no bounds 
given. 

- Find bounds on minimum of unconstrained function. 

- Initial interior points for Golden Section method. 

- Constrained one-dimensional search by Golden Section method. 

- Update bounds and get new interior point in Golden Section 
method, constrained. 

- Find bounds on minimum of constrained function. 

- Unconstrained one-dimensional search by Golden Section 
method. 

- Update bounds and get new interior point by Golden Section 
method, unconstrained. 

- Identify NGT most critical constraints. 

- Invert matrix B and store back in B. 

- Delta-X back to boundary in Modified Method of Feasible 
Directions. 

- Fletcher-Reeves unconstrained minimization. 

- Method of Feasible Directions. 

- X ■ Xold + ALPHA*S, subject to side constraints. 

- Maximum component (magnitude) of each column of A. 
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ROUTINE 


PURPOSE 


ADS209 

ADS211 

ADS213 

ADS214 

ADS216 

ADS217 

ADS218 

ADS221 

ADS223 

ADS231 

ADS 23 5 

ADS236 

ADS301 

ADS302 

ADS303 

ADS304 

ADS 305 

ADS306 

ADS307 

ADS308 

ADS310 

ADS320 

ADS321 

ADS323 


“ Calculate B •» A-Transpose times A. 

- Update convergence parameters IDEL and IDAB. 

- Calculate initial ALPHA for one-dimensional search based on 
objective function value. 

- Calculate initial ALPHA for one-dimensional search based on 
X-values. 

- Finite difference gradients of objective and constraints. 

- Solve direction-finding task for Methods of Feasible 
Directions . 

- Solve special LP sub-problem from ADS217. 

- Push-off factors for Methods of Feasible Directions. 

- Identify active side constraints. 

- Modified Method of Feasible Directions. 

- Variable Metric Methods, IOPT=2,3. 

- Search direction for Variable Metric Methods. 

- Exterior Penalty Function Method, ISTRAT*!. 

- Calculates penalty for penalty function methods, ISTRAT-1-5. 

- Linear Extended Penalty Function Method, ISTRAT=2. 

- Quadratic Extended Penalty Function Method, ISTRAT-3. 

- Cubic Extended Penalty Function Method, ISTRAT-4. 

- Augmented Lagrange Multiplier Method, ISTRAT-5. 

- Update Lagrange Multipliers, 1STRAT”5. 

- Calculate penalty parameters, ISTRAT«5. 

- Sequential Quadratic Programming, lSTRAT-8. 

- Sequential Linear Programming, ISTRAT»6. 

- Control solution of LP sub-problem, ISTRAT-6. 

- Update move limits, ISTRAT-6, 7. 
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ROUTINE 


PURPOSE 


ADS330 

ADS331 

ADS333 

ADS371 

ADS375 

ADS376 

ADS 37 7 
ADS378 
ADS401 
ADS402 
ADS403 
ADS404 
ADS420 
ADS501 
ADS502 
ADS503 
ADS504 
ADS506 
ADS507 
ADS508 

ADS509 

ADS510 


- Method of Centers, ISTRAT=7 . 

- Control solution of LP sub-problem, ISTRAT=7 . 

- Calculate maximum constraint value. 

- Control solution of QP sub-problem, ISTRAT=8. 

- Temporary objective, ISTRAT“8. 

- Gradient of pseudo-objective for one-dimensional search, 
ISTRAT“8. 

- Change in objective gradients, ISTRAT=8. 

- Update Hessian matrix, ISTRAT»8. 

- Print arrays. 

- Print array title and array. Calls ADS401. 

- Print scalar control parameters. 

- Print Hessian matrix. 

- Print final optimization results. 

- Evaluate scalar product of two vectors. 

- Find maximum component of vector. 

- Equate two vectors. 

- Matrix-vector product. 

- Initialize symmetric matrix to the identity matrix. 

- Normalize vector by dividing by maximum component. 

- Calculate gradient of pseudo-objective for ISTRAT“l-5. 
Called by ADS008. 

- Identify active side constraints. 

- Scale, unscale the X-vector. 
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